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A  BEHAVIORAL  MODEL  OK  RATIONAL  CHOICE 


Herbert  A.  Simon 


A  model  ie  proposed  for  the  description  of  rational  choice  by 
or^'anisms  of  limited  computational  ability.^  )  p 


Tne  "flavc.  *•  of  various  models  of  rational  ciioice  is  primarily  due 
to  tr.e  specific  kinds  of  assumptions  toat  are  introduced  as  to  the  "givens" 
or  constraints  within  wtiich  rational  adaptation  must  take  place.  Among  the 
common  constraints — which  are  not  themselves  tne  objects  of  rational  calcula¬ 
tion — are  the  set  of  alternatives  open  to  choicCf  the  relationships  that 
determine  the  payoffs  as  a  function  of  the  alternative  that  is  chosen,  and 
trie  preference-orderings  among  payoffs.  The  selection  of  particular  constraints 
and  the  rejection  of  others  for  incorporation  in  the  model  of  rational  be¬ 
havior  Involves  implicit  assumptions  as  to  what  variables  the  rational 
organism  "controls”— and  hence  can  optimise  as  a  means  to  rational  adapta¬ 
tion— and  what  variables  it  must  take  as  fixed.  It  also  involves  assumptions 
as  to  the  caaracter  of  tr.e  variables  tr.at  are  fixed.  For  example,  by  making 
different  asriumptions  about  the  amount  of  information  the  organism  has  with 
respect  to  tne  relation  betw^.en  alternatives  and  payoffs,  optimization  might 
Ixwolvu  selection  of  a  certain  maximum,  tae  maxiraum  of  an  expected  value, 
or  a  minimax. 

Anoti.er  way  of  characterising  Uie  givens  and  the  behavior  variables 
is  to  say  that  the  latter  refer  to  the  organism  itself,  the  former  to  Its 


«The  ideas  embodied  in  this  memorandum  were  initially  developed  in  a  series 
of  discussions  with  Herbert  Bohnert,  Norman  Dalkey,  Gerald  Thompson,  and 
Robert  Wolf son  during  the  summer  of  1952.  These  collaborators  deserve  a 
large  share  of  the  credit  for  whatever  merit  this  approach  to  rational  choioe 
may  possess. 
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environment .  But  if  wt:  adopt  tnis  viewpoint »  we  must  be  prepared  to  accept 
the  possibility  that  wnat  we  call  "the  environment"  may  lie,  in  part,  within 
the  skin  cf  the  biological  organism.  That  is,  some  of  the  constraints  that 

mu  It  be  taken  as  givens  in  an  optimization  problem  may  be  physiological  and 

psychological  limitations  of  the  organism  (biologically  defined)  itself. 

For  example,  the  maximum  speed  at  which  an  organism  can  move  establishes 
a  boundary  on  the  set  uf  its  available  behavior  alternatives.  Similarly, 
limits  on  computational  capacity  may  be  important  constraints  nlering  into 
the  definition  of  rational  choice  under  particular  circumstances.  It  is  the 
purpose  of  this  memorandum  to  explore  ^  ^^ssible  ways  of  foraiilating  the  pro¬ 
cess  of  rational  choice  in  situations  wher*-  we  wish  to  take  explicit  account 

of  the  "internal"  as  woll  as  the  "external"  constraints  that  define  the 
problem  of  optimization  for  the  organism. 

Whether  our  Interests  lie  in  tiie  normative  or  in  tiie  descriptive 
aspects  of  rational  choice,  the  construction  of  models  of  this  kind  should 
prove  Inwtruccive.  Because  of  the  paycaological  limits  of  the  organism 
(particularly  with  respect  to  computational  and  predictive  ability),  actual 
numan  rationality-striving  can  at  best  be  m  extremely  crude  and  simplified 
approximation  to  the  kind  of  global  rationality  that  is  implied,  lor  example, 
by  game-theoretical  models.  .Vhile  the  approximations  that  organisms  employ 
may  not  be  the  best — even  at  the  levels  of  computational  comp  exity  they  are 
able  to  naixlle — it  is  praoable  that  a  great  deal  can  be  learned  about  possible 
mechanisms  from  an  examination  of  the  schemes  of  approximation  that  are 
actually  employed  by  human  and  other  organisms. 

In  describing  Uie  proposed  model,  we  suall  begin  with  elements  it  has 
in  common  with  the  more  .-lobal  .-'•odels,  and  then  proceed  to  introduce  simpli¬ 
fying  assumj-tions  and  (what  Is  t  e  same  thing)  approximating  procedures. 
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Primitlv  Terma  and  Definitioni 

1.  A  point  set,  A  (tne  set  of  behavior  alternatives). 

?.  A  point  set)  A  .  A^A.  (the  set  of  behavior  alternatives  Uiat  the 
or::anlam  "considers") . 


3.  A  point  set|  S.  (the  set  of  possible  future  states,  or  "outcoeies"  of 

choice) . 


b.  A  real  function  V  (s)  on  the  elements  S<i.S.  (the  pay-off.  For  many 
purposes,  we  need  only  an  ordering  relation  on  pairs  ol  elments  of  S, 
but  for  UiS  moment  wc  postulate  a  cardinal  pay-off.) 

5.  For  eacn  element  a  A,  a  mappint  of  a  on  to  S^,  S  (^S.  (S  is  tne  set 

of  possible  outcomes  of  a).  * 

6.  For  each  a  c,  A  and  s  c.  S  a  real  function,  P  (a),  with  P^  (s)  ^  (a)  =  !• 

(the  probability  that  s  will  occur  if  a  is  choaen)  8  in  a 

Attention  is  directed  to  the  tnree-fold  distinction  drawn  by  the  definitions 
among  A,  S,  and  ?.  In  the  representation  of  a  game,  in  reduced  fora,  by  its 
payoff  matrix,  the  set  S  consists  of  the  cells  of  the  matrix,  A  the  strategiea 
of  the  first  player,  and  V  the  values  in  the  cells.  The  set  3^  is  then  the 
set  of  cells  in  the  aili  row.  By  keeping  in  mind  this  interpretation,  the 
reader  may  compare  tne  present  formulation  with  "classical"  ganie  theory. 

WHh  these  elements,  we  can  define  procedures  of  rational  choice  corre¬ 
sponding  to  the  ordinary  game-theoretical  and  probabilistic  models o 

A.  Game -theoretical  Ciioice  Process.  Select  an  a,  ad  A,  auch  that 

^  “d.r  \/(->}  ^  i'-i  .x  v' 

'  -  .  t  A  t. 

The  terms  in  (2)  and  (6)  do  not  play  any  role  here.; 

B.  Probabilistic  Choice  Process.  Select  an  a,  a  c.  A,  auch  that: 

Vj.vj,  }_  V('.Jr?(i)  =  Z.  Vl'-)P(i) 

r  S  '  ^  -x  r  A  S  .  r 

/-  cx 
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C.  Choice  Under  Certainty*  Suppose  each  a  maps  on  to  a  single  Sg^S. 
then  B  rtducea  toi 

Select  an  a»  a  6  A  such  Uiati 

V  =  M.k  V  ;  - .) 

Cl.  A 

The  Lsaential  Simplifications 

We  now  introduce  some  modifications  that  appear  to  correspond  to 
observed  behavior  processes  in  humans,  and  Uiat  lead  to  substantial  comput¬ 
ational  simplifications  in  the  making  of  a  choice.  There  is  no  implication 
that  Human  beings  use  all  of  these  modifications  and  simplifications  all 
the  time.  The  point  is  rather  that  these  are  procedures  which,  it  is  be¬ 
lieved,  are  sometimes  employed  by  human  beings  in  complex  choice  8ltui>.tion8 
to  find  an  approximate  model  of  manageable  proportions. 

I.  "Flat"  Pay-off  Functions. 

One  route  to  simplification  is  to  assume  that  V  (s)  necessarily 

r  - 1  ) 

assumes  one  of  three  values,  )  0  ^  ,  for  ail  s  c-  S.  Depending  on  the 

L-  1  J 

circumstances,  we  might  want  to  interpret  trese  t.oree  values,  as 
/'  win  I  very  sails  factory 

(a)  )  draw  ^  or  (b)  acceptable  . 

^  lose j  )  unsatisfactory  J 

As  an  example  of  (a),  let  S  represent  the  possible  positions  in  a 

chess  game  at  White's  20th  move.  Then  a  (♦-  1)  position  is  one  in  which 

White  possesses  a  strategy  leading  to  a  win  whatever  Black  does.  A  (0) 

position  is  one  in  which  White  can  enforce  a  draw,  but  not  a  win.  A  (-1) 

position  is  one  in  which  Black  can  force  a  win. 

As  an  example  of  (b)  let  S  represent  possible  prices  for  a  nouse  an 

individual  is  selling.  He  may  regard  $15,000  as  an  "acceptable"  price, 

ar^ything  over  this  amount  as  "very  satisf  ictory",  arythlng  less  as 
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"unsatisfactory" .  In  psychological  theory  we  would  fix  the  zero  point  at 
the  "aspiration  level",  in  econonic  theory  we  would  fix  the  zero  point  at 
the  price  which  evokes  indifference  between  selling  and  not  selling  (an 
opportunity  cost  concept). 

The  objection  may  be  raised  that,  although  116,000  and  $25fOOO  are 
both  "very  uatl  sfactory"  prices  for  tlie  house,  a  rational  individual  would 
prefer  to  sell  at  the  nigher  price,  and  hence,  that  the  simplified  pay-off 
f\inction  is  an  inadequate  representation  of  the  s.tuation.  The  objection 
may  be  answered  in  several  different  ways,  each  answer  corresponding  to  a 
class  of  3  tuations  in  wtiich  the  "flat"  function  might  be  appropriate. 

First,  t.he  Individual  may  not  be  confronted  simultaneously  with  a 

numoer  of  ouyers  offering  to  purenase  the  nouse  at  different  prices,  but 

may  receive  a  sequence  of  offers,  and  a«y  have  to  decide  to  accept  or 

reject  each  one  before  he  receives  the  next.  (Or,  more  generally,  he  may 

receive  a  sequence  of  pairs  or  triplets  or  n-tuples  of  offers,  and  may  have 

to  decide  wtiether  to  accept  the  highest  of  an  n-tuple  before  the  next  n- 

tuple  is  received.)  Then,  if  the  elements  s  correspond  to  n-tuples  of 

offers,  V  (s)  would  be  1  whenever  tne  highest  o:fer  in  the  n-tuple  exceeded 

the  "acceptance  price"  the  seller  had  determined  upon  at  that  time.  We 

could  then  raise  the  further  question  of  what  would  be  a  rational  process 

1 

for  determining  the  acceptance  price./ 


propose  to  deal  with  the  problem  of  a  rational  process  for  determining 
aspiration  levels  in  a  subsequent  paper.  See  also  tne  discussion  below 
of  the  existence  and  'uniqueness  ol  solution. 
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Second,  even  if  there  «fere  a  more  general  pay-off  function,  M  (a), 
capable  of  assuoing  more  than  three  different  values,  the  simplified  V  (s) 
mi gnt  be  a  satisfactory  approximation  to  W  (a).  Suppose,  for  example,  that 
there  were  some  way  of  introducinp  a  cardinal  utility  fiuictlon,  defined  over 

S,  say  U  (s).  Suppose  further  that  U  (^i)  is  a  monotonic  increasing  function 

» 

with  a  strongly  negative  second  derivative.  Then  V  (s)  =  V  ^  W  (a) might 
be  the  following  apprcximationi 


IJ  (a) 
V  (a) 


U  (a) 
V  (s) 


V  =  0 


(♦1  ) 

iVhen  a  simplified  V  (s),  assuming  only  the  values]  0  >,  is  admissible, 

l-O 

under  the  circumstances  Just  discussed  or  under  other  circumstances,  then  a 

rational  decision-process  could  be  defined  as  follows i 

D.  Look  for  a  subset  ^  S  such  that 

V  (s)  =  1  for  all  8  ^  S^, 

,  Look  for  an  a  A  that  maps  on  an  Sg(^S  . 

The  procedure  does  not,  of  course,  guarantee  the  existence  or  uniqueness 

of  an  a  with  the  desired  properties. 


Parentnetlcally ,  it  may  be  noted  that  if  we  start  with  a  more  general 
pay-off  function,  W  (s),  it  is  not  necessary  to  introduce  V  (s)  explicitly. 
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rtorkin^  directly  with  iV  (s),  we  raij.'ht  introduce  comparable  rules  of  tha 
following  peneral  forms i 

E.  Look  for  a  S  ^  S  such  t:;at  V  (s)  ^  k 

for  all  S  ,  where  k  is  some  constant;  or 

F .  ~/i. .  Look  for  a  Sa  C  ^  s’JCh  that 

V  (s)  Pa  (s)^  k  ;  or 

s^Sa 


C.  Look  for  a  Sa  C  S  suc'i  that 


2—  (s)Z  £. 

»iSa 

V  (sjCk 

II.  Information  Gatlicring. 

One  element  of  realism  we  may  wish  to  introduce  is  that,  wnile  V  (s> 
may  be  known  in  advance,  the  mapping  of  A  on  subsets  of  S  may  not.  In  the 
extreme  case,  at  tne  outset  eacn  element,  a,  may  be  mapped  on  the  whole 
set,  S.  He  may  then  introduce  into  the  decision-making  process  information¬ 
gathering  steps  that  pro  luce  a  more  precise  mapping  of  the  various  elements 
of  A  on  non-identical  subsets  of  S.  If  the  information-gathering  process 
is  not  costlei-'s,  then  one  element  in  the  decision  will  be  the  determination 
of  how  far  tne  mapping  is  to  be  refined. 


Now  in  the  case  of  the  simplified  pay-off  functions. 


tne  in¬ 


formation-gathering  process  can  be  streamlined  in  an  important  respect. 
First,  we  suppose  that  tne  individual  rias  initially  a  very  coarse  mapping 
of  A  on  S.  Second,  he  looks  for  an  S'  S  such  tnat  V  (s)  =  1  for  s  £,S’ • 
Third,  he  gathers  information  to  refine  that  part  of  tne  mapping  of  A  on  S 
in  which  elements  of  S'  are  involved.  Fourth,  having  refined  Ute  mapping, 
he  looks  l  or  an  a  that  maps  on  to  a  subset  of  S' . 
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Under  favorable  circumatancesi  this  procedure  may  require  the  in¬ 
dividual  to  gather  only  a  email  amount  of  information— an  inaignificant 
part  of  the  whole  mapping  of  elements  of  A  on  individual  elements  of  S* 

If  the  search  for  an  a  having  the  desirable  properties  is  successful,  he 
is  certain  tr.at  ne  cannot  better  nis  choice  by  securing  additional  in- 
fortoation* 

It  appears  that  the  decision  process  Just  described  is  one  of  the 
important  means  employed  by  chess  players  to  select  a  move  in  the  middle 
and  end  game.  Let  A  be  the  set  of  moves  available  to  White  on  his  20th 
move.  Let  S  be  a  set  of  positions  tnat  might  be  reached,  say,  by  the  30th 
move.  Let  S'  be  some  subset  of  S  that  consists  of  clearly  "won"  positions. 
From  a  very  rough  knowledge  of  the  mapping  of  A  on  S,  i^hite  tentatively 
selects  a  move,  a,  that  (if  Plack  plays  in  a  certain  way)  maps  on  S'.  By 
then  considering  alternative  replies  for  Black,  nhite  "explores"  the  whole 
mapping  of  a.  His  exploration  may  lead  to  points,  s,  that  are  not  in  S', 
but  wliich  are  now  recognized  also  as  wirmin.'  positions.  These  can  be 
adjoined  to  S'.  On  U-e  other  hand,  a  sequence  may  be  discovered  that 
permits  Black  to  bring  about  a  position  that  is  clearly  not  "won"  for 
Hhite.  Then  White  may  reject  the  original  point,  a,  and  try  another. 

Whether  this  procedure  leads  to  any  essential  simplification  of  the 
computation  depends  on  certain  empirical  facts  about  tno  game.  Clearly 
all  positions  can  be  categorized  as  "won",  "lost"  or  "drawn"  in  an  objec¬ 
tive  sense.  But  from  the  standpoint  of  the  player,  positions  may  be 
caterorized  as  "clearly  won",  "clearly  lost",  "clearly  drawn",  "won  or 
drawn",  "drawn  or  lost",  and  so  I'orth— depending  on  the  adequacy  of  his 
mapping.  If  the  "clearly  won"  positions  represent  a  significant  subset 
of  the  objectively  "won"  positions,  then  the  combinatorics  involved  in 


seeing  whetht.r  a  position  can  be  transformed  into  a  clearly  won  position^ 

2 

for  all  possible  replies  by  Black,  may  not  be  unmanageable^/  The  ad¬ 
vantage  of  this  procedure  over  the  more  common  notion  (whidi  may,  however, 
be  applicable  in  the  opening)  of  a  general  valuation  function  for  positions, 
taking  on  values  from  -1  to  1,  is  tnat  it  implies  much  less  complex  and 
subtle  evaluation  criteria.  All  tnat  is  required  is  tnat  the  valuation 
function  be  reasonably  sensitive  in  detecting  when  a  position  in  one  of 
the  tnree  states—won,  lost,  or  drawn — has  been  transformed  into  a  position 
in  another  state.  The  player.  Instead  ol  seeking  for  a  "best"  move,  needs 
only  to  look  for  a  "good"  move. 

Aithin  the  usual  game-theoretical  framework,  it  is  difficult  to  define 
such  terms  as  "attack",  "plan  of  attack",  "initiative",  etc.  In  the  present 
framework,  a  plan  of  attack  is  an  alternative,  a  tnat  maps  the  present 
position  on  seme  set  of  future  positions  wnich  is  regarded  as  satisfactory. 

A  player  has  the  initiative  wtien  iie  has  a  plan  of  attack  that  he  thinks 
leads  only  to  satisfactory  positions.  Since  his  calculations  have  been 
Incomplete,  and  since  he  may  have  mi&valued  certain  future  positions  (has 
regarded  as  "clearly  won"  positions  that  are  defensible  by  his  opponent), 
the  opponent  operates  on  the  defensive  by  trying  to  find  those  paths  that 
the  atticker  has  Inaccurately  analyzed. 

The  term  "counter-attack"  suggests  ttiat  there  is  yet  another  approxi¬ 
mating  mechanism  that  is  involved  in  the  computations.  The  attacker 

2 

This  possibility  has  been  realized  in  two  chess  combinations  of  about 
eight  moves  in  length  with  which  I  have  experimented.  Of  or  more 

legal  sequences  of  plays  available,  only  about  ICO  needed  to  be  explored 
in  each  case  for  a  complete  analysis  of  the  position. 
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consider  only  one  part  of  the  board  in  determining^  «nat  positions  are 
clearly  won,  and  may  ignore  other  parts  of  the  position.  His  opponent 
may  expose  the  fallacy  of  such  a  ceteris  paribus  assumption  by  developing 
an  attack  in  this  other  area.  A  chessboard  is  Just  large  enouj^  so  that 
there  is  a  somewrat  loose  "coupling"  between  the  two  wings,  fiowever,  these 
considerations  go  beyond  the  present  model.  They  are  mentioned  simply  to 
indicate  that  many  other  approximating  mechanisms  may  be  involved  in  choice 
besides  those  explicitly  introduced  here. 

ITT.  Partial  Ordering  of  Payoffs. 

Instead  of  a  scalar  paj^-off  function,  V  (s),  we  might  have  a  vector 
function,  V  (s)  ;  w^.ere  V  has  tne  components  V^,  Vp,  ...  A  vector  pay-off 
function  may  be  introduced  to  handle  a  number  of  situations: 

(1)  Tn  the  case  of  a  decision  to  be  made  by  a  group  of  persons,  the 
components  may  represent  the  pay-off  functions  of  the  individual  memcers 
of  the  groupj 

(?)  In  tne  case  of  an  Individual,  he  may  be  trying  to  implement  a 
nunber  of  values  tnat  do  not  nave  a  common  denominator— e .g. ,  he  compares 
two  jobs  in  terms  of  salary,  climate,  pleasantness  of  «oi-k,  ^^restige,  etc.; 

(3)  ffhere  each  behavior  alternative,  a,  maps  on  a  set  of  n  possible 
consequences,  Sai  we  may  replace  tne  moJel  by  one  in  wi.ich  each  alternative 
maps  on  a  single  consequence,  but  eacr;  consequence  has  as  its  payoff  tlie 
n-dimensional  vector  whose  components  are  tne  payoffs  of  tne  elements  of  Sj^. 

This  representation  exhibits  a  striking  similarity  among  these  three 
important  cases  wtiere  the  traditional  maximizing  model  breaks  down  for  lack 
of  a  complete  ordering  of  the  payoffs.  The  first  case  has  never  been 
satisfactorily  treated— the  theory  of  the  n-person  game  Is  tlie  most  am- 
Ditious  attempt  to  deal  with  it,  and  Uie  weak  welfare  princioles  are 


aliempts  to  avoid  it.  The  ytcoiid  case  is  usually  naudled  by  superiin,.u8ing 
a  complete  orderlntj  on  the  points  in  tne  vector  space  ( "lidifference  curves"). 
Tiie  tr.ird  case  nas  been  nanciled  oy  introducing  probabilities  as  weights  for 
sumjaing  the  vector  components,  or  cy  using  principles  like  minimaxing  regret. 

An  extension  of  the  notion  of  a  simplified  pay-off  function  permits 
us  to  treat  all  three  cases  in  much  the  saae  fashion.  Suppos.  we  regard 
a  payoff  as  satisfactory  provided  w  .at  ^  1<^  for  all  i.  Then  a  reasonable 
decision  rule  is  the  following: 

Look  for  a  subset  S'  S  such  tnat  V  (s)  is  satisfactory  for  all 
s  S'  'i.e.,  V  (s;  k;. 

Then  look  for  an  a  ^  A  sucn  tnat  Sg  O  S'  . 

A^ain  existence  aiid  uniqueness  of  solutions  are  not  guaranteed. 

In  t.'.e  first  of  tne  tnrte  cast-s  mentione  1  above,  the  satisfactory 
payoff  corresponds  to  wnat  I  nave  called  a  viable  solution  in  "A  iormal 
Theory  of  the  Employment  Helation"  and  "A  Comparison  of  Organization  Theories"^^/ 
In  the  secona  case,  Uie  components  of  a  define  the  aspiration  levels  with 
respect  to  several  components  of  payoff.  In  tne  third  case  (in  this  case 
it  is  most  plausible  to  assume  triat  all  tne  component  of  k  will  be  equal), 
may  be  interpreted  as  tne  minimum  guaranteed  payoff —  also  an  aspiration 
level  concept. 
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rjcistfenco  and  Uniqueat;ct>  of  Ijolationa 

Tnr^aghout  our  Jiacusilon  we  have  admitted  decisicn  procedoi-es  t.iat 
do  not  feoaraiitee  the  existence  or  uniqueness  of  solutions.  This  was  done 
in  order  to  construct  a  .uodel  that  parallels  as  nearly  as  possible  the 
decision  procedures  actually  used  by  humans  in  complex  decision-making 
settings.  He  :iow  proceed  to  add  supplementary  rules  to  fill  triis  gap. 

T .  Obtaining  a  dnique  Solution . 

In  most  glocal  models  of  rational  cnoice,  all  alternatives  are 
evaluated  before  a  choice  is  made.  In  actual  numan  decision-making 
alternatives  are  often  examined  sequentially,  fe  ;.iay,  or  may  noty  know 
the  mechanism  that  determines  tne  order  oi  prcctJ’ure.  In  any  case,  we 
may  regar.i  hie  first  satisfactory  alternative  taat  is  evaluated  as  such 
as  the  one  actually  selected. 

if  a  ci.Ui-u  player  finds  an  alternative  U.at  leads  to  a  forced  mate 
for  ills  opf-onent,  ne  ^sderally  aiopts  this  alternative  without  worrying 
about  whether  another  alternative  also  leads  to  a  forced  mate.  In  tnis 
case  we  would  find  it  very  hard  to  predict  wriich  alceri»alive  would  be 
c.iosen,  for  we  nave  no  theory  t;.at  predicts  tne  order  in  .'.hicn  alternatives 
will  be  examined.  But  i.n  Hautner  c-.se  d-rcussed  above — the  sale  ol  a  nouse- 
the  enviroasent  presents  u.e  s.-ller  With  alternatives  in  a  definite  sequence 
and  tne  selection  ol  tne  1  irst  satisfactcry  alttrnative  rias  prb>.ise  mea.dng. 

Ilowevtir,  Tdiere  are  certain  dynamic  considerations,  :iavj  ng  a  gcod 
psychological  foundation,  tnat  ne  should  introiuce  at  this  point.  Let  us 
consider,  instead  <.  i  a  single  static  cj.oicc  situation,  a  sequence  of  auen 
situations.  Tne  aspiration  level,  .r  ich  iaf-^nes  a  satisfactory  alternative 
may  change  from  point  to  point  in  tnis  sequence  of  trials.  A  vague  prlncipL 


would  be  that  as  the  individual,  in  h1s  oXy^lorat ion  of  alternatives,  fincis 
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it-  easy  to  discover  satisfactory  ..Iternatlvcs ,  his  aspiration  level  rleesi 
as  he  finis  it  11  f ficult  to  discover  satisfactory  -ilternatives,  his  aspira¬ 
tion  1 ov=l . falls .  Perhaps  it  wohli  be  possible  to  express  the  ease  or 
difficulty  of  exploration  in  terms  of  tne  cost  of  obtain^  np  betti  Infoma- 
tiori  ibo  it  U:e  mappliif  nf  A  on  5,  or  the  conibi nitorial  marnltuie  of  the 
tar''  refinini>j  this  mappinr,.  There  are  a  n'imber  of  ways  in  #!  ich  this 
fjroct'sr-  cotil  i  be  lefinei  f'-r^  il  ly . 

r.'ich  c;an^^;fs  in  aspiration  level  would  tend  to  brinp  about  a  "near- 
uniqueness"  of  ^ho  satisfactory  solutions  and  would  also  tend  to  /juarantee 
U.e  existence  of  satisfactory  solutions.  For  tne  failure  to  discover  a 
solution  would  depress  tne  aspiration  level  and  bri n^  satisf  otory  solutions 
Into  existence. 

II .  Existence  of  Solutions;  further  Possibilities. 

iif:  have  alreaiy  discusseci  one  necranism  by  which  the  existence  of 
solutions,  in  the  lonj;  run,  is  assured.  There  Is  another  possibility— 
or  at  least  inot.h*,r  way  of  representing  tne  processes  already  described. 

hp  to  this  [cint  rio  use  has  been  made  -^f  the  distinction  between  A,  the  set 

« 

of  behavior  alternatives,  -'’nd  A,  t'u  set  of  oe'^avior  alternatives  that  the 
orftani&Ti  consl  iers,  Cu,  pose  now  t'  at  the  Int'.er  is  <.  ;  ro^  er  subset  of  the 
fo'Tier.  Then,  tt.e  failure  to  find  n  satisfactory  alternative  in  A  may  lead 

U 

to  a  ,‘'.*•arc^  '’or  alditional  alternatives  in  A  t.  at  can  he  adjoined  to  A* 

This  i  rocerlure  is  simply  an  elai)orntion  of  tne  i ;  J'ornatlsn-path'Ti  n^  pro¬ 
cess  previnusly  described ,  ( /Te  can  regard  the  elements  of  A  innt  are  not 
in  A  «r.  einmt  nts  that  are  initially  mappe  d  on  the  whole  set,  S.; 

i  one  oi  parubf  dyn.im:c  a  ijust.nent  over  a  sequence  of  choices  nay 

dejcrd  prlnurlly  upon  adjust-nunts  of  the  aspiration  levtl.  In  another 

I  ' 

orpani'am,  tn«'  adjusUiu  nts  may  he  prlmarl  ly  in  the  set  At  if  satisfactory 
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alternativ«8  are  discovered  easily,  A  narrows;  if  it  beccxnes  difficult 

L/ 

to  find  satisfactory  alternatives,  A  broadens.  The  acre  persistent  the 

U 

organism,  Uie  greater  the  role  played  by  the  adju6t:nent  of  A,  relative  to 
the  role  . layed  by  the  adjustment  of  the  aspiration  level.  (It  is  possible, 
of  course,  and  even  probable,  tiiat  there  is  an  asymmetry  betiween  adjustments 
upward  and  downward.) 

Further  Comments  on  Dynamics 

Tne  models  tnus  far  discussed  are  dynamic  only  in  a  very  special 
sensei  the  aspiration  lovel  at  time  t  depends  upon  the  previous  history 
of  the  system  (previous  aspiration  levels  and  previous  levels  of  attain¬ 
ment).  Another  kind  of  dynamic  linkage  might  be  vory  important.  The  pay¬ 
offs  in  a  particular  trial  night  depend  net  only  on  tne  alternative  cnosen 
in  that  trial  but  also  on  the  alt  rnatives  chosen  in  previous  trials. 

The  most  direct  representation  of  this  situation  is  to  include,  as 
components  of  a  vector  pay-off  function,  the  payoffs  for  the  wTiole  sequence 
of  trials.  But  then  optimization  woula  require  U.9  selection,  at  the  be¬ 
ginning  of  the  sequenc-.  ,  of  a  8trate,y  for  the  whole  sequence.  Suen  a 
procedure  would  again  rapid.  /  complicate  the  proolera  beyond  tne  computa¬ 
tional  capacity  of  the  organism.  A  possible  .-nidile  ground  is  to  define 
for  each  trial  a  pay-off  function  witr*  two  components.  One  would  be  the 
"Immediate"  payoff  (consumption),  the  otner,  the  "position"  in  which  the 
organism  is  left  for  future  trials  (saving  ,  li(}ui.lity) . 

Let  U6  consider  a  cr.ess  game  in  wi.ich  the  players  are  paid  off  at  the 
end  of  each  ten  moves  in  projortion  to  arbitrarily  assigned  values  of  their 
pieces  left  on  the  board  (say,  queen,  1;  ro  ic,  ID;  etc.).  Tneri  a  player 
could  adopt  some  kind  of  piaunln  aorizon  and  include  m  his  estimated 
payoff  the  "goodness"  of  his  position  at  the  planning  horizon.  A  comparable 
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notion  in  economics  iy  that  of  the  depreciated  value  of  an  a^set  at  the 
planning’  hori/on.  To  compute  such  a  value  precisely  would  require  the 
player  actually  to  carry  his  strategy  beyond  the  horlion.  If  there  lo 
time  (1i3Countin4;  of  payoffs,  this  has  the  advantage  of  reducing  the  im¬ 
portance  of  errors  in  estimating  these  depreciated  values.  (Time  dis¬ 
counting  may  sometimes  be  essential  in  order  to  assure  convergence  of  the 
summed  pa^-offs.) 

It  is  easy  to  conjure  up  other  dynamic  complications,  which  may  be  of 
considerable  practical  importance.  Two  more  may  be  mentioned— without 
attempting  to  incorporate  them  formally.  The  consequences  Uiat  the 
organism  experiences  may  change  the  pay-off  function — it  doesn't  know 
how  well  it  likes  cheese  until  it  has  eaten  cheese.  Likewise,  one  method 
for  refinin,;  the  mapping  of  A  on  S  may  be  to  select  a  particular  alttrnatlve 
and  experience  its  consequences.  In  tiiese  cases,  one  of  the  elements  of  the 
payoff  associated  with  a  particular  alternative  is  the  information  »,hat  is 
1  athered  about  the  mapping  or  about  the  pay-off  function. 

Conclusion 

Tile  aim  of  this  paper  has  been  to  construct  definitions  of  "rational 
choice"  that  are  modeled  more  closely  upon  the  actual  decision  processes  in 
the  behavior  of  organisms  than  definitions  heretofore  proposed.  We  have 
outlined  a  fairly  complete  model  for  tne  static  case,  and  nave  described 
one  extension  of  this  model  into  dynamics.  As  naa  been  Indicated  In  the 
last  section,  a  great  ieal  remains  to  be  done  before  we  can  handle  real¬ 
istically  a  more  completely  dynamic  system. 

Tn  the  introduction,  it  was  suggested  Uiat  definitions  of  tr.ie  kind 
.ni  fit  nave  normative  as  well  as  descriptive  value.  In  particular,  they 
may  suggest  approac;ies  to  rational  choice  in  areas  that  appear  to  be  far 
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beyond  the  capacities  of  existing  or  prospective  cooputing  equipment.  It 
nas  often  been  pointed  out  tnat  a  canparison  of  the  I.Q.  of  a  computer  #ith 
tnat  of  a  human  being  is  very  difficult.  If  one  were  to  factor  t-he  scores 
made  by  each  on  a  comprehensive  intelligence  testi  one  would  undoubtedly 
find  toat  in  tnose  factors  on  which  Uie  one  scored  as  a  genius  the  other 
would  appear  a  moron — and  conv.rsely.  A  survey  of  possible  definitions 
of  rationality  cilj-ht  suggest  directions  for  the  design  and  use  of  computing 
equipment  witr.  reasonably  good  scores  on  some  of  the  factors  of  intellicence 
in  wnich  present  computerc  are  moronic. 
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